Cooperative searching for stochastic targets 
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Spatial search problems abound in the real world, from locating hidden nuclear or chemical 
sources to finding skiers after an avalanche. We exemplify the formalism and solution for spatial 
searches involving two agents that may or may not choose to share information during a search. For 
certain classes of tasks, sharing information between multiple searchers makes cooperative searching 
advantageous. In some examples, agents are able to realize synergy by aggregating information 
and moving based on local judgments about maximal information gathering expectations. We also 
explore one- and two-dimensional simplified situations analytically and numerically to provide a 
framework for analyzing more complex problems. These general considerations provide a guide for 
designing optimal algorithms for real-world search problems. 



I. INTRODUCTION 

In the real world, there are many spatial search prob- 
lems that involve multiple agents or searchers. Commu- 
nication between such agents or between agents and a 
centralized command center may be sensitive, costly, or 
difficult for various reasons. In this work, we explore 
spatial search problems in this context and examine the 
classes of search problems for which communication and 
coordination between multiple agents will enable quan- 
titative advantages over independent information gath- 
ering. These problems are very general and can be for- 
malized and solved in terms of information theory. The 
solutions are essential to the development of quantita- 
tive decision support tools under uncertainty (e.g. in 
medicine |9() and for automated multi-agent searches for 
stochastic information s uch as those involving dis- 
tributed sensor networks . 

A search may be thought of as a series of steps by which 
an agent or agents reduce the uncertainty of the location 
of a target to zero. This location may be in physical space 
or in a "space of possibilities," i.e., a set of alternative 
scenarios. For example, if you need to find your keys in 
the morning before going to work and there are five rooms 
in your house, initially you know your keys must be in 
one of these rooms. After thoroughly searching one room 
and not finding the keys, your uncertainty is reduced; the 
keys must now be in one of the four remaining rooms, and 
so on. If you find the keys in the second room, then the 
uncertainty of their location is immediately zero because 
you know with complete certainty that they are in your 
hand. 

Now imagine you have a friend help you search. The 
two of you would be searching twice as fast since, as- 
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suming you and your friend share information, a pair 
of searchers can eliminate rooms at a rate twice as fast 
as that of a single searcher. In more complex search 
problems, the target might emit some kind of compli- 
cated signal that makes it possible for multiple coordi- 
nated searchers to dramatically increase efficiency (imag- 
ine there are one thousand rooms to search but the keys 
are attached to some kind of radioactive homing beacon 
or can emit a sound). In these situations, understanding 
the nature of the clues and sharing information can be 
extraordinarily beneficial. 

A search whereby agents move based expressly on in- 
formation cues rather than following gradients is known 
as an infotaxis search. In a 2007 paper, Vergassola et al. 
explored infotaxis in the context of a moth following a 
pheromone trail through air to find a mate. The moth 
was performing a spatial search in turbulent air currents 
that carried the trail h 18]. Compared to more conven- 
tional methods such as chemotaxis (following a chemical 
gradient @, EH), infotaxis gives an advantage in situ- 
ations when the signals from the target of the search 
are uncertain. This might be the case if signals from 
the target are stochastic, difficult to measure, or highly 
varying in time. In the case of the moth, the signal was 
sparse and widely dispersed by the turbulent air currents. 
When the moth followed the gradient of the strength of 
the trail directly chemotaxis it was forced to take a 
very circuitous route due to the turbulent dispersal of 
the trail. However, when the moth employed an info- 
taxis algorithm to move to positions where it might gain 
the most information about the source of the trail, its 
performance improved significantly. Since we will con- 
sider only search problems such as these, in the following 
we will refer to the target of an infotaxis search as the 
"source." The formalism of infotaxis balances the com- 
peting goals of exploiting the current information avail- 
able and exploring to gain more information, a familiar 
compromise from other unsupervised learning methods, 
such as reinforcement learning [l7| . While effective path 
planning algorithms may be based on the optimization 
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of some objective function, these often rely on exploiting 
some features of the known environment jl 21 ] rather than 
a solid foundation based on information theory. Info- 
taxis provides a framework for studying search problems 
in general and is therefore broadly applicable. 

In this article, we explore conditions in which cooper- 
ation between multiple infotaxis agents is advantageous. 
We focus on examples in which agents are able to re- 
alize synergetic cooperation by aggregating information 
and moving based on a local infotaxis algorithm. Syn- 
ergy, and its opposite, redundancy, are information the- 
oretic quantities that are defined in terms of relative 
probabilities of the stochastic variables involved 0]. In 
a recent paper, we showed that spatiotemporal correla- 
tions are necessary for synergy When synergy is 
exploited effectively it can lead to an exponential re- 
duction in the search effort, in terms of time, energy, 
or number of steps [j| [13, S3- Here we use a simple 
one-dimensional search example and a more realistic two- 
dimensional generalization to show how correlations lead 
to synergy. These simple examples provide a framework 
for analyzing more complex problems. Since, in general, 
the computational cost is greater for searchers to com- 
municate and perform coordinated movements instead of 
moving based on independent decisions, we will describe 
situations in which coordination is worthwhile. 



II. INFORMATION THEORY APPROACH TO 
STOCHASTIC SEARCH 

Effective and robust search methods for locating 
stochastic sources balance the competing strategies of 
exploration and exploitation [l7| . Given a current esti- 
mated probability distribution for the location of a source 
a searcher might cither exploit the data already collected 
by moving towards the location that maximizes this like- 
lihood or sharpen the distribution (reduce uncertainty 
further) by moving to gather more diverse data. The in- 
fotaxis search balances these two strategies by optimiz- 
ing the expected information gain over the possible next 
search moves. In the following we review some basic con- 
cepts from information theory and formalize the infotaxis 
algorithm in terms of these quantities. 



A. Information, synergy, and redundancy 

To determine whether searchers can be effectively co- 
ordinated we define define synergy and redundancy as 
information theoretical quantities [6j and use them as a 
measure of coordination. Synergy is found when measur- 
ing two or more variables together with respect to another 
(e.g. the source's signal) results in a greater informa- 
tion gain than the sum of that from each variable sepa- 
rately [4, 5]. In search problems, synergy is advantageous 
because then the coordination of two or more searchers is 
more efficient than the same searchers working indepen- 



dently. In this section we will introduce these concepts in 
general terms before applying them to a specific search 
problem. 

Consider the stochastic variables Xi,i = 1 . . . n. Each 
variable Xi, representing a searcher or source location, 
can take on specific states, denoted by the corresponding 
lowercase letter Xi . For a single variable Xi the Shannon 
entropy (henceforth "entropy") is 

S{X i ) = -Y J P{x i )\og 2 P{x i ), 

Xi 

where P(xt) is the probability that the variable Xi takes 
on the value Xi Q. The sum is over all of the possible 
states Xi\ since P(xi) < 1 always, the entropy is always 
positive. The entropy is a measure of uncertainty about 
the state of Xi, therefore entropy can only decrease or 
remain unchanged as more variables are measured. The 
conditional entropy of a variable X\ given a second vari- 
able X 2 is 

Xl,X2 

This expression contains a sum over the joint probabil- 
ity distribution of two variables. Since measuring a sec- 
ond variable can only decrease entropy (or leave it un- 
changed), the conditional entropy is bounded above by 
the entropy of the first variable. The mutual information 
between two variables, which plays an important role in 
search strategy, is defined as the change in entropy when 
a variable is measured: 

I(X 1 ,X 2 ) = SiX,) - 5(Xi|X 2 ) > 0. 

This is also the difference between the entropy of one 
variable and its entropy conditioned on the measurement 
of a second variable. Mutual information is always posi- 
tive. These definitions can be directly extended to mul- 
tiple variables. Just as entropy may be conditioned on 
an additional measurement, mutual information may be 
conditioned on the knowledge of other variables. These 
quantities may be used to generate new information the- 
oretic constructs that we will use in specific search prob- 
lems. For three variables [15| the quantity 

R{X 1 ,X 2 , X 3 ) ee I(X 1 ,X 2 ) - I({X U X 2 }\X 3 ) (1) 

measures the degree of "overlap" in the information con- 
tained in variables X\ and X 2 with respect to X%. The 
sign of this quantity is meaningful. If R(X\, X 2 , X3) > 0, 
there is overlap and X\ and X 2 are said to be redundant 
with respect to X3. If R{X\, X 2 , X3) < 0, more infor- 
mation is available when these variables are considered 
together than when considered separately. In this case 
X\ and X 2 are said to be synergetic with respect to X3. 
If R(Xi, X 2 , X3) = 0, X\ and X 2 are independent. 
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B. Bayesian inference and spatial infotaxis 

We first formulate the general spatial stochastic search 
problem for N searchers seeking to find a stochastic 
source located in a finite, ZJ-dimensional space. This 
is a generalization of the single searcher formalism pre- 
sented in Ref. [l8j . At any time step, the searchers 
Si, i = 1,2, ...,N, are located at position r\ and ob- 
serve some number of particles hi from the source. The 
searchers do not get information about the trajectories or 
speed of the particles; they only get information if a par- 
ticle was observed or not. Therefore simple geometrical 
methods such as triangulation are not possible. 

Consider a random variable Rq, which can assume a 
number of specific values, denoted by ro . The values of ro 
refer to positions in space that may contain the stochas- 
tic source. Only one value of r corresponds to the (yet 
unknown) location of the source sq- The searchers com- 
pute and share a probability distribution Pw(ro) for the 
source location at each time index t. Initially the proba- 
bility for the source P(°\ro) is assumed to be to be uni- 
form. After each measurement {hi, r^}, the searchers up- 
date their estimated probability distribution of source po- 
sitions via Bayesian inference [2j and decide what move to 
make (possibly remaining at the same position). The goal 
of Bayesian inference is to improve an estimated proba- 
bility distribution P(X), where X is a random variable 
that can assume a set of values denoted by x. Assuming 
that Y is another random variable (that can assume a 
set of values denoted by y) and that X and Y are not in- 
dependent (that is, I(X, Y) ^ 0), knowledge of the state 
of Y can be used to improve P(X). After a measure- 
ment reveals Y — y, the probability of this measurement 
given the current estimated is computed. The probabil- 
ity of this measurement is P(Y = y\X). Bayesian in- 
ference makes it possible to assimilate this information 
into the current estimate of P(X) via a Bayesian update 
step: P(X) = P(X\Y = y) = P(Y = y\X)P(X)/A, 
where A is a normalization factor. This step includes an 
explicit statement of equivalence because each new mea- 
surement is included implicitly in P(X). Therefore the 
measurement Y — y improves the estimate of P(X). The 
searchers will use this Bayesian inference framework to 
improve their estimate of the probability distribution of 
source locations p(°\ro) after each measurement hi,ri. 

To decide where to move next, the searchers follow 
an infotaxis algorithm for multiple searchers. First the 
conditional probability 

p( t+1 )(ro|{^i}) = ip (t) (ro)P({^,ri}|r ) , (2) 

is calculated, where A is a normalization over all possi- 
ble source locations r as required by Bayesian inference. 
This is then assimilated via Bayesian update, 



p( t+1 )(r )=P( t+1 )(ro|{^,n}). 



(3) 



If the searchers do not find the source at their present 
locations they choose the next local move using an in- 



fotaxis step to maximize the expected information gain. 
The expected information gain is computed in the fol- 
lowing way. The entropy of the distribution pW(ro) at 
time t is defined as 



^pW(r )log 2 pW(r ) 



(4) 



For a specific measurement {hi, r^} the entropy before the 
Bayesian update is 

Sg tn} (Ih) ^-^pW(r |{/ l i ) r i })log 2 pW(r |{/ li ,r i }). 

ro 

(5) 

We define the difference between the entropy at time t 
and the entropy at time t+1 after a measurement {hi, r{\ 
to be 



AS 



(t+i) 

{h t ,r t } 



(6) 



For a uniform prior, p(°)(r ) = 1/M for M possible lo- 
cations of the source in the discrete space, the entropy 
is maximum, S^°\Rq) = log 2 M. For each possible joint 
move {r{\, the change in expected entropy AS is com- 
puted and the move with the minimum (most negative) 
AS is executed. 

The expected information gain is found by computing 
the entropy change for all of the possible joint searcher 
moves 



AS = - 



S W (R ) 



(7) 



The first term in Eq. (|7|) corresponds to one of the 
searchers finding the source in the next time step (the 
final entropy will be S = so AS* = —S). The second 
term considers the reduction in entropy for all possible 
measurements at the proposed location, weighted by the 
probability of each of those measurements. The proba- 
bility of the searchers obtaining the measurement {hi} at 
the location {ri} is given by the trace of the probability 
p( t+1 ^ ({hi, ri}\ro) over all possible source locations. 

At each step the searchers move jointly to increase the 
expected information gain as measured by the change in 
entropy of the probability distribution. Although this 
algorithm is general in the following we consider only the 
case of two searchers (N — 2) and both one- and two- 
dimensional spatial domains. 



III. SEARCHING FOR CORRELATED SIGNALS 
IN ONE DIMENSION 

Sources that emit uncorrelated signals provide no op- 
portunity for coordination because the searchers are 
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never synergetic We instead consider signals with 

spatial, temporal, or other correlations. The simplest 
nontrivial example is searching in a one-dimensional do- 
main for a source that emits two particles simultaneously 
in opposite directions. Two searchers should be able to 
exploit the correlations in the signal; if both searchers 
simultaneously observe particles, they can immediately 
conclude that the source is located between them. There- 
fore we expect synergy to be possible for some spatial 
arrangements of the source and searchers. 

First consider a finite one-dimensional domain with a 
source so and two searchers si and s 2 at the correspond- 
ing positions {r ,ri,r 2 } G [0, 1]. The source is assumed 
emit two particles simultaneously and in opposite direc- 
tions. That is, one particle is emitted to the left and one 
to the right of the source. The two searchers Si and s 2 are 
identical with a fixed cross section such that < a < 1 is 
the probability of a searcher capturing one of the parti- 
cles emitted from the source. At each step in the search 
the number of particle "hits" measured by searchers Si 
and s 2 are denoted by hi 6 {0, 1} and h 2 E {0, 1}, re- 
spectively. 

To calculate R(r 0l hi, h 2 ) it is first necessary to com- 
pute the probabilities of hi for each searcher given the 
position of the source tq. We note that since there is no 
distance dependence in the capture probability a, it is 
sufficient to consider three separate cases depending on 
the relative positions, or ordering, of the source and the 
searchers, as shown in Fig. [TJ For example, if si is to the 
left of the source and s 2 is to the right of the source, the 
order is SiS s 2 . Note this is equivalent to the case s 2 s Si 
since the searchers are identical. 

So S2 S\ SQ S2 S\ S2 So 

r o n n 1 n r r 2 1 n n ro 1 

FIG. 1: The three unique cases for relative positions of the 
source and two identical searchers on a one-dimensional do- 
main. Since the probably of detection in this example does 
not depend on distance, we need only consider the spatial ar- 
rangement of the source and searchers. The cases are labeled 
SiSjSk according to the relative spatial ordering for the source 
so and searchers si,S2. Since the searchers are identical, si 
and S2 are interchangeable and there are only three unique 
cases. 

If a searcher observes a particle, it is assumed to be 
absorbed so that the other searcher will not be able to 
observe it. For example if si is between s 2 and the source 
(case soSis 2 or s 2 siSq) then the probability that s 2 ob- 
serves a particle depends on whether si observed it. If 
si observed it, then the probability that s 2 observes it 
must be 0. If si did not observe it then the probability 
that s 2 will observe it is a 

P(h 2 = l\h 1 = l,r )=0, (8) 
P(h 2 = l\h 1 = 0,r ) = a. (9) 



We can use the probability relation 

P{h 2 ,hi\r ) = P{h 2 \h u r )P{hi\r ) (10) 

to compute the two-searcher conditional probabilities 

P(/ l2 = l,/ ll = l|r )=0, (11) 
P(h 2 = l,h 1 = 0\r ) = a(l-a). (12) 

The other probability distributions are computed using 
similar reasoning. The results are summarized in TablelU 



Cases 


hi,fi2 


P{h x \ro) 


P(fo|ro) 


P({hi,h2}\r ) 




1,1 


a 


a(l — a) 





S0S1S2 


1,0 


a 


1 - a(l - a) 


a 


S2S1S0 


0,1 


1 - a 


a(l — a) 


a(l — a) 




0,0 


1 - a 


1 - a(l - a) 


(1-a) 2 




1,1 


a 


a 


a 2 


SiS S 2 


1,0 


a 


1 - a 


a(l — a) 


S2S0S1 


0,1 


1 - a 


a 


a(l — a) 




0,0 


1 - a 


1 - a 


(1-a) 2 




1,1 


a(l — a) 


a 





S0S2S1 


1,0 


a(l — a) 


1 - a 


a(l — a) 


S1S2S0 


0,1 


1 - a(l - a) 


a 


a 




0,0 


1 - a(l - a) 


1 - a 


(1-a) 2 



TABLE I: Conditional probabilities for the six possible ar- 
rangements of the source so and searchers si,S2 shown in 
Fig. [T] Since the searchers are identical, si and S2 are inter- 
changeable and there are only three unique cases. In cases 
S0S1S2 and S2S1S0, searcher one is between the source and 
searcher two. A particle emitted by the source in the direc- 
tion of the searchers will reach searcher one first. If searcher 
one detects the particle, searcher two will not be able to de- 
tect it. Searcher two will only have a chance of detecting 
the particle if the particle passes through searcher one unde- 
tected. Similarly, in cases S0S2S1 and S1S2S0, the source is 
between the searchers and the searchers do not interfere with 
each other. Furthermore, since the source emits two particles 
simultaneously in opposite directions, in only these cases do 
both searchers have a chance of each detecting a particle. 

Using TablelU we can analytically compute the infor- 
mation theoretic quantities we need to determine synergy 
and redundancy. These are 

R{hi,h 2 ,r ) = I{h u h 2 ) ~ I(h 1> h 2 \r ), (13) 
^« 5 £*^^ (14) 

hi ,li2 

and 

I(hi,h 2 \r ) =J2 hl j l2 Io dr P(hi,h 2 ,r ) (15) 

P(hi,h 2 \r ) , 
i0g2 P(hi\r )P(h 2 \r y 
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where the probability distributions are calculated as fol- 
lows: 



P(hi ) h2,r ) = P(hi,h 2 \ro)P{ro), 



(16) 
(17) 

(18) 

(19) 



Initially we consider a uniform probability distribution 
(prior) of source locations: P(r ) = 1. 

For small capture probability, a, we can expand 
Eq. (TT31 as a Taylor series in a to get an analytical so- 
lution for the critical values a c where i?| a=ac = 0. For 
T\ > r 2 , the critical values are given by 



P{h x ,h 2 ) = dr P(h u h 2 \r )P(ro), 
Jo 

P(hi) = [ dr P(hi\r )P(r ), 
Jo 

P(h 2 ) = f dr P(h 2 \ro)P(r ). 



3(r 2 - ri) log (n - r 2 ) 
r\ — r% — ir\ + 2r\ + r 2 ' 



(20) 



For r\ < r 2 , a c is given by Eq. (|20p under the trans- 
formations ri — > r 2 and ^2 — > r\. These relations give 
the approximate boundary between the regions of syn- 
ergy and redundancy. In the limit n — > r 2 , R — > 0. 
For these formulas we used a uniform source distribution 
P( r o) = 1 but it is possible to repeat these calculations 
with a different P(r ). 

For larger values of a, when the expansion is no longer 
valid the condition R — [as in Eq. (TT5T) ] can be solved 
numerically. Figure [2] shows R(h\,h 2 ,ro) as a function 
of the capture probability a and searcher s\ location r\ 
with searcher s 2 fixed at r 2 = 2/3. This figure also shows 
R(hi,h 2 ,ro) for a Gaussian probability of the source lo- 
cation P(ro) = B exp( — (ro — 1/3) 2 ), where B is a normal- 
ization factor. In both cases, R > (indicating redun- 
dancy) when the searchers are close together and R < 
(indicating synergy) when they are further apart. For the 
Gaussian distribution source location synergy is strongest 
when si is close to the source because the mutual infor- 
mation between ro and h\ is peaked there as well. 

Figure [21(a) shows how the capture probability a influ- 
ences the possible strategies of the searchers. If a is close 
to 1, then the searchers only realize synergy if they are 
far apart, which maximizes the chance of the source be- 
ing between them. But if a is is close to then nearly any 
arrangement of searchers is synergetic but only weakly. 
Figure &h) demonstrates the significance of the prior 
P(ro) in the calculation of R(hx,h 2 ,ra). The variance 
of P (r ) is equal to 1, the size of the domain, making 
the Gaussian distribution quite broad. Nonetheless, the 
fact that the prior is weakly peaked at some point in the 
domain dramatically reduces the area of the redundant 
(R > 0) region and allows for much greater synergy be- 
tween the searchers. Although search problems in the 
real world are rarely one-dimensional, this example illus- 
trates the basic calculations for determining synergy. 
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FIG. 2: Synergetic and redundant regions for two searchers 
in the one-dimensional correlated search problem. The value 
of R(hi, h,2, ro) is shown for different locations ri of si with 
S2 held fixed at T2 — 2/3 and the capture probability varying 
from a = (no capture) to a — 1 (complete capture). Darker 
regions represent higher synergy (larger negative values of R) 
and the white areas represent redundancy. The critical con- 
tour line R = separates the synergetic and redundant re- 
gions, (a) When the source is equally likely to be anywhere, 
P( r o) — 1, there is only weak synergy, (b) Then the proba- 
bility of the source is a Gaussian distribution centered at 1/3, 
P (ro) oc exp(— (ro — 1/3) 2 ), the synergy is highest near the 
source at 1/3 since the mutual information is highest there as 
well. The dashed line in (a) shows the critical values a c com- 
puted by the approximation in Eq. (|20[) ; this approximation 
is good for a c < 0.3. 



IV. SEARCHING FOR CORRELATED SIGNALS 
IN TWO DIMENSIONS 

The one-dimensional example provides a tractable 
starting point for generalization to two-dimensional prob- 
lems. The simplest generalization is the case of two 
mobile searchers and one stationary source in a two- 
dimensional finite domain. Imagine a source in which 
chemical or nuclear reactions are occurring and the prod- 
ucts of the reactions leave the source with relative angu- 
lar correlations. Our two-dimensional idealized problem 
consists of a source that emits 2 particles simultaneously 
at each time step in opposite directions along some emis- 
sion axis. At each time step, a new emission axis angle is 
chosen uniformly at random from (0, 2~k\. The particles 
move along straight-line trajectories but the searchers are 
not able to measure the velocities of any detected parti- 
cles, so geometric methods such as triangulation are not 
possible. 
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FIG. 3: Diagram for the two-dimensional example. The 
source position ro is fixed in the center and the searchers 
are disks of radius d. At each time step the source emits two 
particles in in opposite directions with a random angle. Each 
possible emission axis passing through the source corresponds 
to one of six cases for source and searcher configurations as 
given in Tables. [I] and [TTJ 



In the real world, searchers could be, for example, au- 
tonomous mobile sensors capable of detecting radiation 
or other reaction products from the above example. Most 
modern-day autonomous robots do not move much faster 
than a walking pace |l3|, largely due to the difficulties 
of navigating uncertain terrain safely. Thus movement 
is relatively costly (backtracking will take a significant 
amount of time) and the searchers should make decisions 
to refine their trajectories often, using any new avail- 
able information. For this problem, this means that the 
searchers can only make small discrete movements be- 
tween measurements. 

To represent simplified mobile autonomous robots, we 
cast the searchers as identical disks of radius d that move 
on a regular Cartesian grid. Unlike the one-dimensional 
case these searchers have spatial extent; there are two 
parts to the calculation of particle detection. First, if a 
particle travels along a straight line trajectory that passes 
through a searcher, the capture probability is < a < 1. 
As in the one-dimensional example, if a particle is ob- 
served by a searcher, it is absorbed so it cannot be ob- 
served by the other searcher. Second, we must consider 
the probability that the particle's trajectory will pass 
through the searcher. This is a function of the searcher 
radius d and the distance to the source. The variables r , 
r\ , and ri for the positions of the source and searchers 
each have two components, e.g.(ro, x , r o,y), since they rep- 
resent positions on a two-dimensional grid. 

As in the one-dimensional example, there are differ- 
ent cases for the probabilities which depend on the rel- 
ative position of the two searchers to the source. For 
all possible straight line emission axes passing through 
the source, some lines may pass through no searchers 
(case so), only searcher s\ (case sqSi), or only searcher 
S2 (case S0S2). If a line passes through both searchers, 
the source is between the searchers (case S1S0S2 as in the 
one-dimensional example), or one of the other searchers 
is in front of the other (cases S0S1S2 and so^si as in the 



one-dimensional example) . These cases are illustrated in 
Fig. [3] For any source location, there will be a range 
of angles A9 C for each case c. The probabilities for the 
cases that do not appear in the one-dimensional example 
(see Table HJ are detailed in Table HU Quantities such 
as P(hi,fi2\ro) are a superposition of the values for the 
different cases, weighted by the proportion of angles cor- 
responding to each case 

An 

P{h 1 ,h 2 \r )= -^ p c(hi,h 2 \r ), (21) 

c£ {cases} 

and similarly for other quantities such as P(hi\ro), etc. 
While it is in principle possible to find the A9 C analyti- 
cally using geometry, in practice it is much more efficient 
to do this numerically. 



Case 


hi,h 2 


P(hi\r ) 


P(h 2 \r ) 


P({h 1 ,h 2 }\r ) 




1,1 











so 


1,0 





1 







0,1 


1 










0,0 


1 


1 


1 




1,1 


a 








SOSl 


1,0 


a 


1 


a 




0,1 


1 - a 










0,0 


1 - a 


1 


1 - a 




1,1 





a 





S0S2 


1,0 





1 - a 







0,1 


1 


a 


a 




0,0 


1 


1 - a 


1 - a 



TABLE II: Conditional probabilities for cases unique to the 
two dimensional example in Fig- [3] The cases S1S0S2, S0S1S2, 
and S0S2S1 (not shown), are identical to those of the one di- 
mensional problem given in Table [I] As shown in Figure 3, 
the case so corresponds to the range of angles for which it is 
impossible for either searcher to detect a particle. Case sosi 
corresponds to the range of angles for which only searcher 
one has a chance of detecting a particle, and case sosi corre- 
sponds to the range of angles for which only searcher two has 
a chance of detecting a particle. 

Note that the different cases in the one-dimensional 
example were taken into account implicitly during inte- 
gration as in Eq. (fT9"|) . In the two-dimensional example 
they are taken into account when the effective probabil- 
ity distributions are computed as a superposition of the 
probabilities of the individual cases. This is because there 
is more than one case for each source location relative to 
the searchers. 

We illustrate the two-dimensional searcher problem 
with a setup of searcher and source locations that illus- 
trate the synergetic and redundant positions. We use the 
Gaussian prior for the initial guess 

P(r ) = Aexp- l|r °~ 5112 , (22) 
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where A is the normalization and a determines the over- 
all shape of the distribution. The vector s — (2, 2) is 
the most probable position of the source. The quan- 
tity R(hi,li2,ro) [see Eq. (JTJ] determines whether the 
searchers are positioned synergetically relative to the 
source. When the searchers are performing an infotaxis 
search, realizing synergetic relative positions will in prin- 
ciple lead to the fastest reduction in uncertainty. 

In Fig. H] we plot R as a function of the position of one 
searcher n with the position of the second searcher ri 
held fixed. We find for this example that only synergy 
(R < 0) is possible. The light areas in Fig. 2] correspond 
to weak synergy and the dark areas to stronger synergy. 
As in the one-dimensional example synergy is strongest 
for large a and when searcher s\ is near the source and 
not behind searcher S2- A small cross section [a — 0.25 in 
Fig. 3(a)] allows only for weak synergy, whereas a larger 
cross section [a = 0.75 in Fig. Efb)] gives much stronger 
synergy for certain relative positions. The strongest syn- 
ergy comes from a large cross section paired with opti- 
mal positioning. The maximum synergy is realized when 
searcher si is close to the peak of P and especially when 
the peak of P is between the searchers, Note that un- 
favorable positions (such as n = (5,2), behind searcher 
S2) provide minimal synergy regardless of the value of a. 

For real-world problems, larger cross sections yield 
more information and therefore stronger synergy is pos- 
sible. However for some applications the cross section of 
a sensor on a searcher may be limited by practical con- 
siderations such as weight or power consumption. This 
example shows that synergy is still possible for small a. 
Furthermore, this example emphasizes the importance of 
the probability estimate of source locations P(ro). The 
infotaxis algorithm is designed such that the searchers 
will explore, gathering new information, if their arrange- 
ment is not sufficiently synergetic to warrant exploita- 
tion. This allows the searchers to succeed even with no 
starting information, but they may not realize strong syn- 
ergy until the estimate of P(ro) is sufficiently refined. 



V. CONCLUSION 

In this work we studied search algorithms for au- 
tonomous agents looking for the spatial location of a 
stochastic source. In spatial search problems, since the 
exploitation of synergy requires spatial or temporal cor- 
relations, we considered problems in which a source emits 
two particles simultaneously in opposite directions. This 
is a simplification of physical problems in which there is 
a reaction and the products travel in directions that have 
angular correlations. We showed that both synergy and 
redundancy are possible for one-dimensional search prob- 
lems but not for two-dimensional searches, where only 
synergy is possible. Since even unfavorable arrangements 
of searchers are synergetic, in two-dimensional search 
problems like these coordination is always advantageous. 
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(a) 



Synergetic (R < 0) 




Synergetic (R < 0) 



FIG. 4: Synergy for two searchers for two-dimensional corre- 
lated signals. The value of R(hi, h,2, ro) is shown as a function 
of the position n of searcher si for two different values of the 
capture probability a: (a) a = 0.25; (b) a — 0.75. The po- 
sition of searcher S2 is fixed r2 = (2,4). The most probable 
source location (the peak of the Gaussian distribution for the 
initial source location) is at ro = (2,2). Darker blue corre- 
sponds to stronger synergy (R < 0). Synergy is strongest 
for large a and when searcher si is near the source and not 
behind searcher S2 relative to the source. 



Simple examples such as these that can be studied an- 
alytically provide insight into real-world problems. In 
real-world problems, there will necessarily be additional 
considerations. It may not always be possible to write 
a closed-form equation for the nature of the correlations 
in the signal from the source. It may be necessary to di- 
rectly measure any correlations and use this to estimate 
capture probabilities. Furthermore, various probabilities 
may not be stationary in time or the signals from the 
source may get progressively weaker. For example, sig- 
nals from a radio transmitter may decrease in strength 
over time as its batteries are slowly exhausted. An addi- 
tional consideration is that in the real- world, communica- 
tion between agents may only be possible at certain times 
and may not be instantaneous as in our simple examples. 
These general considerations are crucial for the exploita- 
tion of multi-agent infotaxis in terms of the design of 
optimal collective algorithms in particular applications. 
The next steps for making this approach applicable to a 
broader class of problems, including those not limited to 
spatial searches Q, are to generalize the results to more 
than two searchers and to explore how synergy may be 
best leveraged to give increases in search speed and effi- 
ciency. 
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